(19) 



J) 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



II 



11 



(12) 



(n) EP 0 891 061 A2 

EUROPEAN PATENT APPLICATION 



(43) 


Date of publication: 


(51) mt ciA H04L 29/04, H04L 29/06, 




13.01.1999 Bulletin 1999/02 




H04L 12/46 


(21) 


Application number: 98305410.7 








Datp of filinn- 07 07 1 998 

L/GIC Ul Hill IU< v* * \f $ * 1 w \J 






(84) 


Designated Contracting States: 


(72) 


Inventors: 




AT BE CH CY DE DK ES Fl FR GB GR IE IT U LU 


• 


Congdon, Paul 




MC NL PT SE 




Granite Bay, California 95746 (US) 




Designated Extension States: . 


• 


Krelie, Brian 




AL LT LV MK RO SI 




Rose vi lie, California 95747 (US) 


(30) 


Priority: 08.07.1997 US 889317 


(74) 


Representative: Powell, Stephen David et al 








WILLIAMS, POWELL & ASSOCIATES 


(71) 


Applicant: Hewlett-Packard Company 




4 St Paul's Churchyard 




Palo Alto, CA 94303 (US) 




London EC4M SAY (GB) 



(54) Method and system for link level server/switch trunking . 



CM 
< 

T— 

to 
o 

O) 
CO 

o 

Q. 

UJ 



(57) I n a method and system are provided for trunk- 
ing multiple links between. a switch and a server, server 
drivers recognise and automatically configure additional 
installed network interface cards (NICs) or multi-port 
NICs as group members. A monolithic driver, or an over- 
laying driver shim makes the group of NICs appear to 
be a single NIC to the server operating system and cli- 
ents. Multiple NICs having the same MAC addresses 
and appearing on different ports are connected directly 
to a switch which treats the group as a single logical 
port. Using a deterministic algorithm, the switch looks 
up a received packet's destination in the address table. 
A list of possible ports for reaching the server and a flag 
indicating that the server is to be reached via this 
trunked group of ports are retrieved. The switch selects 
a port based upon the packet's source address. On the 
trunk to the clients, the server driver performs the same 
deterministic algorithm on the destination addresses. 
The invention supports fault tolerance. In one embodi- 
ment, a single switch is connected to a server via mul- 
tiple NIC links. In another embodiment, the server is 
connected via multiple NIC links to a plurality of switch- 
es. To mitigate effects of the same source MAC address 
appearing on packets received from multiple ports in a 
group, the switch is notified that it is acceptable to see 
the server's MAC address appearing on several ports 
and is directed not to notify the system operator thereof. 



Foi lover ond Trunking with 
Switch Participation 



|0rv shiaf -''^"^ 
^^573 (073 



A 



Generic Switch 



(p © 



FIG. 3 



BEST AVAILABLE COPY 



1NSDOCID: <EP 089106 1A2J_> 



Prhted by Jouve. 75001 PARIS (FR J 

( 



1 



EP 0 891 061 A2 



2 



Description 

The invention relates to networked computer sys- 
tems. More particularly, the invention relates to a meth- 
od and system, including a failover system, for trunking 
multiple links between a switch and a server. 

As the use of networked computer systems increas- 
es, the need has arisen to provide additional bandwidth 
to handle the electronic traffic on the network. For ex- 
ample, inadequate bandwidth can result in data stalling 
in the pipeline between a client and a server This stall- 
ing can significantly limit network performance. 

Network interface cards (NIC) are the attachments 
that are used to connect a server or any computing de- 
vice to a network. Such NICs include, for example, 
Ethernet cards or Token Ring cards that plug into a desk- 
top computer or server. The NIC implements the phys- 
ical later signaling and the Media Access Control (MAC) 
for a computer attached to a network. Adding additional 
NICs to a computer effectively attaches the computer to 
a network multiple times. This increases the potential 
bandwidth into the network proportionally. 

Load balancing is a technique used to reduce data 
bottlenecks caused by an overloaded communications 
network. In load balancing, the traffic between a server 
and a network over multiple NICs is balanced. Such load 
balancing typically requires software and a bridge or 
Ethernet switch between the server and client(s). Load 
balancing software, such as BALANCE. NLM from Net- 
work Specialists, Inc. of Lyndhurst, NJ and SWITCH. 
NLM from Kalpana of Sunnyvale, CA, is available in the 
form of a NetWare loadable module (NLM). This soft- 
ware is used for servers running Novell, Inc. NetWare 
NOS software. 

Load balancing also provides fault tolerance, which 
maintains data communication between the server and 
the network in the event of a disruption in a data link. In 
a "failover" system, for example, a secondary link takes 
over the load if the primary link fails, such that signal 
continuity is maintained. 

Fig. 1 is a schematic diagram of a failover system 
1 0 according to the prior art, in which data are transmit- 
ted between the server 1 2 and clients 22 via a generic 
switch 24. Multiple links 1 8, 20 connect the switch to the 
server 12. Software drivers 16 control the transmission 
of data to and from the server over these links. If, for 
example, a NIC or network cable fails, traffic between 
the server and the network is passed to other functioning 
connections. Each NIC has an associated MAC address 
which is required for the NIC to receive packets on the 
network. In Fig. 1, the NICs for links 18 and 20 each 
have different MAC addresses, designated "A" and "A*. 
" Only one of these NICs is active at a time. No clients 
are attached to the standby NIC (A 1 ). Thus, if the primary 
NIC (A) fails, the standby NIC assumes its address in 
accordance with the server protocol 14. 

"Trunking" is another scheme for increasing band- 
width to the server. Fig. 2 is a schematic diagram of a 



trunking system 28 according to the prior art, in which 
data are transmitted between the server and the clients 
22 via a generic switch 24. Trunking is used with multiple 
server/network interfaces. In Fig. 2, multiple links 18, 26 
5 link the switch to the server. The MAC addresses des- 
ignated "A" and "B" are different for each of the NICs 
associated with the links 18, 26. Software drivers 16 
control the flow of data to and from the server through 
these links. Using multiple network interfaces may result 
io in a complex system configuration. Trunking minimizes 
this complexity by presenting the server as a single en- 
tity to the clients in the network. In an ideal trunking con- 
figuration, multiple interfaces in the server are also pre- 
sented to the server as a single interface. 

A server typically has three levels of addressing. 
The first level is a Name, often an ASCII string such as 
"Serverl." The second addressing level is the Network 
Address, for example, an IP address such as 
"111.22.33.44." The third level is the MAC address. Dif- 
ferent levels of software in the client identify the server 
by these different addresses. 

Typically, a higher level address is mapped to a sin- 
gle instance of the address at the next level down. For 
example, a Name maps to a single IP address which 
maps to a single MAC address. In applications that em- 
ploy trunking, multiple instances of addressing to the 
next level down are implemented. These multiple in- 
stances must be mapped into a single upper layer ad- 
dress. This mapping function is performed by the net- 
work protocols 1 4. For example, if a client has the name 
of the server to which it is to be connected but does not 
have the IP server's address, it invokes an address res- 
olution protocol to determine the server's IPaddress. 
Thus, one function of the protocols is to resolve a lower 
layer address, given the address at a next layer up. 
These protocols are typically request/reply protocols. 

Trunking involves identifying a portion in the client- 
to-server communication process where a mapping 
may be performed to allow a single server to use multi- 
ple network interfaces. This mapping may be performed 
at either of two points during the client-to-server com- 
munication process by using address resolution proto- 
cols. For example, Server Name to Network Level Ad- 
dress Mapping includes Domain Name Services (DNS) 
and NetBIOS name resolution; and Network Level Ad- 
dress to MAC Address Mapping includes Address Res- 
olution Protocol (ARP) and General Server Query/Near- 
est Server Query (GSQ/NSQ). DNS and ARP are Inter- 
net protocols, while GSQ/NSQ is a protocol of Novell, 
Inc. 

With lower level mapping, there is more opportunity 
for NICs and switches to participate in the trunking proc- 
ess. For example, BALANCE. NLM trunking supports 
any third-party NIC or switch. A separate media access 
controller (MAC) address is used for each NIC for a sin- 
gle network address. BALANCE. NLM requires a high 
software overhead, and its fault-tolerance, scheme re- 
lies on higher-layer support or dropped connections. 
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The BALANCE. NLM driver captures information 
generated during the network address to MAC address 
mapping process to "spool". The term 'spoofing" refers 
to performing a process in a way that gives the appear- 
ance that the process was performed in a standard way, s 
although the process was actually performed in a non- 
standard way. In the case of BALANCE. NLM, it appears 
to a client that its receiving the MAC address which 
maps to the server's network address. It also appears 
to the client that there is only one such MAC address, io 
as is normally true. In actuality, the software spoofs the 
normal process by allowing multiple MAC addresses to 
be used. 

Switch/NIC coordination schemes do not support 
third-party NICs or switches. A low level of software 15 
overhead is required tor the driver in the outbound 
(sending) direction. No software is required in the in- 
bound (receiving) direction. The server selects an out- 
put link via a simple function on the destination address. 
The switch selects the trunk link to the server based up- 20 
on the same function on the source address. Connec- 
tivity is not lost if the link in the trunk fails. In such 
scheme, the same MAC address is used for all NICs. 
Thus, the NIC driver-to-switch protocol can be designed 
to permit auto-configuration. 25 

Another trunking scheme uses a switch as a NIC 
card, or implements a switch in software using multiple 
NIC cards. In this scheme, there is a single MAC ad- 
dress for server identification of clients. The network op- 
erating system treats the switch as a NIC. The correct 30 
output link for delivery of traffic to clients is resolved by 
the switch card. This scheme requires either switching 
NICs, or requires significant server overhead. In such 
scheme, a spanning tree configuration is used to pro- 
vide fault tolerance in case of failover. A switch address 35 
mapping scheme may be used to reduce software over- 
head. Such scheme supports third-party NICs. A switch 
software module is required to communicate to the 
switch. The switch actively participates in the address 
resolution process and performs load balancing by an- 40 
swering a client request with an address that should as- 
sist in load balancing. Additionally, the server driver 
must perform load balancing based upon the load or 
destination address. 

However, the prior art methods for installing multiple 45 
NICs into a server are difficult to design and are subject 
to various problems arising from the complicated soft- 
ware and hardware configurations required. For exam- 
ple, higher-level mapping schemes such as BALANCE. 
NLM require a higher-intelligence-level driver. Further- so 
more, the BALANCE. NLM fault-tolerance scheme relies 
on higher-layer support or dropped connections. BAL- 
ANCE. NLM clients are also spoofed such that it appears 
that they are receiving the only MAC address which 
maps to the server's network address when, in actuality, ss 
multiple MAC addresses are used. This can create a 
confusing representation of the server for the client. 

Typically, when multiple NICs are installed into 



standard Novell, Inc. or microsoft NT servers, each NIC 
has a unique MAC address. This unique MAC address 
maps to a unique IP or IPX network address which then 
maps to a server name. A server that has two NICs also 
has two names and two network addresses. This is com- 
plex and potentially confusing to the network adminis- 
trator. If one of the NICs fails, all clients connected to 
the server via that NIC are disconnected. The clients 
must have the name and network address of the other 
NIC to reestablish a connection. This may require a dif- 
ferent network path to the other NIC. Additionally, the 
use of such multiple names and addresses for a single 
server can impair, or even prevent, fault tolerance. 

When multiple NICs are installed in a server, a spe- 
cial layer of software is required in the server to give the 
multiple NICs the appearance of a single NIC to the 
server network software. The multiple NICs, however, 
do not appear as a single NIC to the clients because 
each NIC has its unique MAC address. These unique 
MAC addresses are provided to the client and switches. 

Using a switch as a NIC card, or switching in soft- 
ware requires redundancy protocols (e.g. spanning 
trees) and increases costs. The switch mapping support 
trunking scheme requires a high level of intelligence in 
the switch. Additionally, the prior art schemes may re- 
quire special hardware support on the server side, as 
well as a higher-intelligence-level server. 

It would therefore be an advantage to provide a 
method and system for supporting multiple NICs in a 
server, where such NICs are viewed as a single NIC to 
both clients and the higher layers of the internal server 
software. It would be yet another advantage if such 
method and system supported fault tolerance. It would 
be a further advantage if such method and system in- 
creased bandwidth without requiring any reconfigura- 
tion of the server. 

The invention provides a method and system for 
trunking multiple links between a switch and a server. 
One feature that distinguishes the invention from the pri- 
or art is the combination of switch hardware and server 
driver software. The invention provides both a trunking 
system and a failover system having active switch par- 
ticipation with the server NIC driver during load balanc- 
ing. 

In the invention, additional NICs or multi-port NICs 
are installed into a server. The drivers in the server rec- 
ognize the additional NICs and automatically configure 
each additional NIC to be a member of a group that may 
include NICs that are already installed in the server. No 
additional reconfiguration of the server is required to add 
the additional NICs. A thin layer of software, referred to 
as the "driver shim," overlays the drivers to make the 
group of NICs appear as a single NIC to the network 
operating system and to the clients in the network. 

The invention supports multiple NICs having the 
same MAC address by appearing on different ports. The 
NICs in the group are connected directly to a switch 
which recognizes the group as a single logical port, i.e. 
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trunk. The NICs in the group function as multiple links 
to balance the traffic load to the clients. Each NIC uses 
the same MAC address for the network interface. 

The driver and the switch examine the MAC ad- 
dress fields to select a link. When traffic from a client s 
arrives at the server, the switch executes a deterministic 
algorithm on the data packet transmitting the traffic. Up- 
on receiving a packet, the switch identifies the destina- 
tion address in the address table. The corresponding 
entry returns a list of possible ports which can be used 10 
to reach the server and a flag which indicates that the 
server is to be reached via this trunked group of ports. 
The switch then selects a port in this group based upon 
the source address in the packet. The algorithm looks 
at the source address in the packet and selects one of 
the links in the group. 

The driver in the server performs the same deter- 
ministic algorithm on the trunk to the clients, but on the 
destination addresses. The server software, including 
the driver shim, gives the group of NICs the appearance 20 
of as a single NIC and performs load balancing based 
upon the destination address. In an alternative embod- 
iment of the invention, a monolithic driver specific to a 
vendor's NIC is used to give the group of NICs the ap- 
pearance of a single NIC. 2s 

The preferred embodiment of the invention sup- 
ports a fault tolerance feature. In a first preferred em- 
bodiment of the invention, a single switch is connected 
to a server via multiple NIC links. The links to the server 
are configured as a trunk in which the load balancing 30 
algorithm uses the source address of the clients to se- 
lect a link. 

The multiple NICs in the server program their MAC 
addresses to be the same on all interfaces. Therefore, 
the same MAC address that is used as the server's 35 
source address is provided to the switch for the multiple 
NIC ports. When a client sends a packet via a hub to the 
server, the switch selects one of the multiple ports by 
looking at the client's MAC address. 

In a second embodiment of the invention, the server <o 
is connected via multiple NIC links to a plurality of 
switches. A switch-to-switch link directly connects the 
switches together. A client can send a packet to the serv- 
er via either path of the tree. However, it is preferable 
for a client to use the same path for a particular data «s 
communication. The invention may be implemented us- 
ing any number of switches or links supported by the 
network and server. 

In a generic, prior art I EEE 802. 1 D bridge, a switch 
looks up a destination MAC address in the address table so 
to find the appropriate output port for a packet. This table 
is created by the learning process of looking at the 
source MAC addresses in received packets. When a 
switch receives a packet on a particular port, it can as- 
sume that the host which sent the packet can also re- ss 
ceive packets from that port. The switch notes the input 
port for a received packet and then" updates the address 
table with this information. 



If the address table already contains an entry for the 
source MAC address, the port in the address table and 
the port by which the packet was received should be the 
same. If the ports are not the same, then the MAC ad- 
dress is presumed to have moved. This move indication 
creates a move condition which is identified by the soft- 
ware that manages the address table. The address table 
should be updated with the new port to which the MAC 
address is assumed to have moved. 

For a switch which supports trunking, it is possible 
that the same source MAC address is identified for pack- 
ets received from any number of ports in the group. It is 
not desirable to create a move condition, or to update 
the address table continually. When multiple NICs in a 
server are attached to a network and these NICs use 
the same MAC address, it is possible to receive packets 
with this MAC address as the source MAC address on 
many ports. Therefore, the invention provides a scheme 
that mitigates the effect of the switch-to-switch link on 
the return of such packets from the server to the client, 
and that substantially prevents interruptions in the serv- 
er caused thereby. 

In this scheme, the switch is allowed to ignore the 
move interrupt even if the port where the address has 
been seen is not in the group of trunk ports. A flag for 
the server's MAC is included in the switch's address ta-~ 
ble. The flag notifies the switch that it is acceptable to 
see the server's MAC address appearing on several 
ports. The switch is directed not to notify the system op- 
erator that the address has moved. 

Fig. 1 is a schematic diagram of a failover system 
according to the prior art; 

Fig. 2 is a schematic diagram of a trunking system 
according to the prior art; 

Fig. 3 is a schematic diagram of a trunking and 
failover system with switch participation according 
to the invention; 

Fig. 4 is a schematic diagram of a switch that in- 
cludes a link level trunking system according to the 
invention; 

Fig. 5 is a schematic diagram of the link level server/ 
switch trunking system according to a first preferred 
embodiment of the invention; and 

Fig. 6 is a schematic diagram of the link level server/ 
switch trunking system according to a second em- 
bodiment of the invention. 

The invention provides a method and system for 
trunking multiple links between a switch and a server. 
One feature that distinguishes the invention from the pri- 
or art is the combination of switch hardware and server 
driver software. The invention provides both a trunking 
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system and a failover system having active switch par- 
ticipation with the server NIC driver during load balanc- 
ing. 

Fig. 3 is a schematic diagram of a trunking and 
failover system 30 having switch participation according 
to the invention. In the invention, additional links 38, 40 
are provided for which NICs or multi-port NICs are in- 
stalled in a server 32. A multiport NIC is a NIC that has 
multiple network attachments. The number of NICs in a 
system is limited by the number of slots in the server 
and the number of ports on the switch. A multiport NIC 
offers the advantage of using fewer server bay slots to 
provide multiple attachments to the network. No addi- 
tional hardware or software configuration is required to 
use such multiport NICs. 

The drivers 36 in the server recognize the additional 
NICs and automatically configure each additional NIC 
to be a member of a group that may include NICs that 
are already installed in the server. A thin layer of soft- 
ware,, referred to as the "driver shim" 46, overlays the 
drivers 36. The driver shim gives the group of NICs the 
appearance of a single NIC to the network operating 
system (NOS). Additionally, the group appears as a sin- 
gle NIC to the clients 42 in the network. 

When a client attempts to resolve the MAC address 
for the server's single network address, it always re- 
ceives the same MAC address in any scheme. In the 
prior art schemes discussed above, the client may re- 
ceive a different MAC address. If a NIC having one of 
these different MAC addresses fails, all client connec- 
tions to the server via that NIC also fails. The client must 
then relearn the network address to MAC address map- 
ping. This is not necessary in the invention because the 
same MAC address is used on all of the NICs. 

The NICs in the group are connected directly to a 
switch 44 which treats the group as a single logical port, 
i.e. trunk. This configuration requires the server to be 
directly attached to the switch. The NICs in the group 
function as multiple links to balance the traffic load to 
the clients. 

Switches generally make switching decisions 
based upon the destination address of a data packet. 
However, each NIC in the invention uses the same MAC 
address for the network interface. The MAC interface is 
the interface between the network attachment (NIC) and 
the computer by which information is transmitted and 
received on the network. The MAC implements a proto- 
col which attaches the computer to the network. The 
MAC interface provides the NIC with a mechanism for 
transferring information into and out of the MAC. The 
MAC interface is described in IEEE document 802.2, in- 
corporated by reference as a part of this application. 

The invention supports multiple NICs that have the 
same MAC address but that appear on different ports. 
In the invention, a switch implements a deterministic al- 
gorithm (discussed below) that forwards packets to an 
address on the trunk links. When a client sends a packet 
to the server, the destination MAC address in the packet 



is the server's address and the source address is the 
client's address. Upon receiving the packet, the switch 
looks up the destination address in the address table. 
Because the destination MAC address is that of the 

s server, an entry for the server exists in the table. This 
entry returns a list of possible ports which can be used 
to reach the server and a flag which indicates that the 
server may be reached via this trunked group of ports. 
The switch then selects a port in this group based upon 

10 the source address in the packet. 

The flag directs the switch to a table of N entries, 
where N is a power of two, up to a maximum size of 
N=2 M =2 48 . The table typically contains 2 5 entries. The 
source MAC address of the packet is used to calculate 

'5 an index into this table. The bwest M bits of the source 
MAC address are used to calculate an entry into the ta- 
ble. Because 2 M =N, the lowest M bits are taken as a 
direct index into the table. The entry in the table is the 
port number to which the packet is forwarded. 

20 As an example, if the table contains 32 entries, then 
M=5. If there are four ports, (ports 1-4) trunked to the 
server, the table of 32 entries has the numbers 1 -4 even- 
ly distributed as entries in the table. The numbers may 
be distributed throughout the table in any acceptable 

25 way. When a packet is received for the server MAC ad- 
dress which is reachable by one of these ports, the low- 
est five bits in the client's MAC address are used to index 
directly into the table. The port number found at the table 
index is the port to which the packet is forwarded. 

30 On the trunk to the clients, the driver 36 in the server 
performs the same deterministic algorithm, but on the 
destination addresses. The server software, including 
the driver shim, give the group of NICs the appearance 
of a single NIC, and performs load balancing based up- 

35 on the destination address in accordance with the server 
protocol 34. 

The algorithm is executed by the driver shim to se- 
lect one port in the trunk group within the switch for pack- 
ets addressed to the server. The low order bits in the 

40 destination MAC address are used to index into the ta- 
ble. This is one significant consideration for transmitting 
packets. When receiving packets, the server driver only 
accepts broadcast packets on one of the links. Broad- 
cast packets received on any other NICs in the group 

45 are discarded. 

The driver and the switch are not required to per- 
form complex packet analysis to select a link. Rather, 
the driver and the switch examine the MAC address 
fields. These fields are at a fixed offset within the packet 

50 from the beginning of the packet. For example, the for- 
mat of an Ethernet packet is: 

TABLE 1 



55 



|| DA | SA | Type/LerT Data || 



where: 
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DA = destination MAC address (48 bits) 

SA = source MAC address (48 bits) 

Type/len = Packet length or Ethertype (16 bits) 

Fig. 4 is a schematic diagram of a switch that in- 
cludes a link level trunking system according to the in- 
vention. A standard switch 70 forwards packets re- 
ceived on input ports 75-77 to an appropriate output port 
71-74. When a packet 80 is received by the switch, the 
switch examines the DA field 81 in the packet in order 
to forward the packet. The switch holds an address table 
79 which contains a list of MAC addresses and the ports 
by which they can be reached. The switch looks up the 
DA in the address table to find the destination output 
port. If the DA is not found, the switch floods the packet 
to all output ports. If the DA is found, the switch sends 
the packet only to the port listed in the table. 

. In the invention, the address table also contains a 
flag which indicates that the DA is reachable by multiple 
output ports, rather than just one port. These multiple 
output ports are the trunk group (discussed above). The 
flag also directs the switch to the table of N entries (de- 
scribed above). The switch looks at the SA 82 to find an 
index in the trunk table 78 and thereby select the appro- 
priate output port. 

A particular source and destination MAC address 
pair always use the same link in the group, in accord- 
ance with bridging standards, such as the IEEE 802.1 D 
standard. This standard indicates that packet order 
must be preserved by a switch. Always selecting the 
same link for a given SA/DA pair guarantees such pack- 
et order. 

The prior art methods for installing multiple NICs in- 
to a server require complex software and hardware con- 
figurations. Higher-level mapping schemes, such as 
BALANCE. NLM require a higher-intelligence-level driv- 
er. The use of multiple NIC addresses can create a con- 
fusing representation of the server to the client and may. 
require the client to have the name and network address 
of other NICs in the event it is necessary to reestablish 
a dropped connection. The use of such multiple names 
and addresses for a single server can impair, or even 
prevent, fault tolerance. 

By contrast, the invention performs a mapping be- 
tween multiple NICs and a network address by coordi- 
nating the operation of a switch with software in the serv- 
er. The NICs all have the same MAC address and are 
active on the network at the same time. This is typically 
an impossible or illegal situation in the prior art. The in- 
vention functions because the switch is aware of the sit- 
uation and hides any problems associated therewith 
from the clients. 

For example : the invention eliminates the need to 
create two network names and use two network ad- 
dresses when using two NICs in a server. To the clients, 
the server has only one name and one network address. 
Thus, if one of the NICs fails, there is no need to rees- 
tablish a new connection to the server. The switch hides 



the network failure from the clients. 

The invention is more advantageous than the prior 
art higher level mapping schemes because there is a 
single mapping from Name to network address to MAC 
5 address. Additionally, the invention requires lower serv- * 
er overhead. 

The invention is also an improvement over prior art 
schemes that use a switch as a NIC or that switch in 
software, e.g. the invention does not require redundan- 
io cy protocols, such as spanning trees, and is lower in cost 
than such switch NICs. Furthermore, the invention re- 
quires less intelligence in the switch than the hybrid ap- 
proach, and does not require special hardware support 
on the server side. 
*s The preferred embodiment of the invention sup- 
ports a fault tolerance feature. Fig. 5 is a schematic di- 
agram of the link level server/switch trunking system ac- 
cording to a first preferred embodiment of the invention. 
In Fig. 5, a single switch 50 is connected to a server 52 
via multiple links 54. The links to the server are config- 
ured as a trunk in which the load balancing algorithm 
uses the source address of the clients 56 to select a link. 

Multiple NICs in the server program their MAC ad- 
dresses such that they are the same on all interfaces. 
Therefore, the same MAC address used for the server's 
source is applied to multiple ports 62. When a client 
sends a packet via a hub 58, 60 to the server, the switch 
selects one of the multiple ports by examining the cli- 
ent's MAC address. 

Fig. 6 is a schematic diagram of the link level server/ 
switch trunking system according to a second embodi- 
ment of the invention. In this embodiment, the server 52 
is connected via multiple links 54, 74 to a switch 64, and 
via multiple links 70, 72 to a switch 66. A switch-to- 
switch link 68 connects the switches 64 and 66. Switch 
64 is joined to a hub 60 and the switch 66 is joined to a 
hub 58 : respectively. The hubs then connect to the cli- 
ents 56. While Fig. 6 shows the server connected to two 
switches, one skilled in the art will readily appreciate that 
the invention may be implemented using any number of 
switches or links supported by the network and server. 

Traffic from a client that travels through the nearest 
switch to the server may be routed to the correct links 
using the link selection scheme described above. How- 
ever, in this system, packets having the server's source 
address may cross the switch-to-switch link. This 
switch-to-switch link is not included in the server trunk 
group. 

For a switch which supports trunking, it is possible 
to have the same source MAC address on packets re- 
ceived from any number of ports in the group. It is not 
desirable to create a move condition, or to update the 
address table continually. When multiple NICs in a serv- 
er are attached to a network and the NICs are using the 
same MAC address, it is possible to receive packets 
with this MAC address as the source MAC address on 
many ports. The invention therefore also provides a 
scheme that mitigates the effect of the switch-to-switch 
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link on the return of such packets from the server to the 
client, and that prevents interruptions in operation of the 
server caused thereby. 

In this scheme, the switch is allowed to ignore the 
move condition even if the port where the address is 
seen is not in the group of trunk ports. Aflag for the serv- 
er's MAC is included in the switch's address table. The 
flag notifies the switch that it is acceptable for the serv- 
er's MAC address to appear on several ports. The server 
is directed not to notify the system operator that the ad- 
dress has moved. It will be readily apparent to one 
skilled in the art that other schemes; or combinations of 
the schemes discussed above, may be implemented to 
facilitate the server-to-client transmission of traffic that 
has crossed the switch-to-switch link. 

Although the invention is described herein with ref- 
erence to the preferred embodiment, one skilled in the 
art will readily appreciate that other applications may be 
substituted for those set forth herein without departing 
from the spirit and scope of the present invention. 

The server driver, driver shim, and protocol soft- 
ware are readily generated by one skilled in the art using 
well-known programming techniques. The switch hard- 
ware is similarly configured by one skilled in the art. 

The invention is also adapted for use with a vendor- 
specific monolithic driver. Such driver is specific to the 
vendor's NIC. 

Accordingly, the invention should only be limited by 
the Claims included below. 



Claims 

1. In a computer network, a method for trunking mul- 
tiple links between a switch and a server, the server 
having either of additional network interlace cards 
(NICs) and multi-port NICs installed therein, the 
method comprising the steps of: 

recognising and configuring said additional 
NICs or multi-port NICs as members of a group; 
making said group appear to be a single NIC to 
said server's operating system and clients; 
treating said group as a trunk having multiple 
ports; 

selecting, from a source address of a packet 
received at said switch, one of said ports to 
reach said server; and 

selecting from a destination address of a packet 
sent from said server, one of said ports to reach 
said client. 

2. The method of Claim 1 , further comprising the step 
of said multiple NICs in said server programming 
their MAC address to be the same on all interfaces. 

3. The method of Claim 1 , wherein said step of select- 
ing a port to reach said server further comprises the 



step of switch performing a deterministic algorithm 
on said packet. 

4. The method of Claim 3, wherein said step of per- 
5 forming said deterministic algorithm further com- 
prises the steps of: 

said switch looking up the destination address 
of said server packet in the address table of 
10 said switch; 

returning to said switch a flag indicating said 
server is to be reached via said multiple ports; 
said flag directing said switch to a table contain- 
ing the numbers of each of said multiple ports 
is distributed therein as entries; 

said switch indexing into said table, wherein the 
lowest M bits of the source MAC address of said 
packet are used to calculate said index; 
said switch selecting one of said ports based 
20 upon said entry found at said index. 

5. The method of Claim 1 , further comprising the step 
of mitigating the effects of the same source MAC 
address appearing on packets received from said 

25 multiple ports and preventing resulting interruptions 
in said switch, said mitigating step comprising the 
steps of: 

notifying said switch that it is acceptable to see 
30 said server's source MAC address appearing 

on said multiple ports; and 
directing said switch not to notify said network's 
system operator thereof. 

3S 6. The method of Claim 1 , further comprising a fault 
tolerance step which comprises the steps of: 

a) the switch seeing said MAC address used as 
said server's source on said multiple NIC ports; 

40 and 

the switch selecting one of said multiple 
ports by looking at said client's MAC address; 
wherein data communication between said 
server and said client is maintained in the event 
45 of a disruption in a link to said ports; or 

b) connecting said server via multiple NIC links 
to a plurality of switches in a hubbed tree struc- 
ture; and 

connecting said switches together with a 
so switch-to-switch link to create a plurality of 

paths in said tree, such that a packet may be 
communicated over any of said paths; 
wherein data communication between said 
server and said client is maintained in the event 
ss of disruption in one of said links to said ports. 

7. In a computer network, a method for trunking mul- 
tiple links between a switch and a server having ei- 
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ther of additional network interface cards (NICs) 
and multi-port NICs installed therein, comprising 
the steps of: 

a server driver recognising and configuring said 5 
additional NICs or multi-port NICs as member 
of a group; 

making said group appear to be a single NIC to 
said server's operating system and clients us- 
ing one of a monolithic driver, or a driver shim 10 
overlaying at least one of said server drivers; 
a switch connected to said group treating said 
group as a trunk having multiple ports; 
providing fault tolerance; 

selecting, from a source address of a packet is 
received at said switch, one of said ports to 
reach said server; - 

selecting, from a source address of a packet 
received at said switch, one of said ports to 
reach said server; 20 
selecting, from a destination address of a pack- 
et sent from said server, one of said ports to 
reach said client; 

notifying said switch that it is acceptable to see 
said server's source MAC address appearing 25 
on said multiple ports; and 
directing said switch not to notify said network's 
system operator thereof. 



tiple links between a switch and server, comprising: 

means for recognising and configuring either of 
additional network interface cards (NICs) or 
multi-port NICs as members of a group; 
means for making said group appear to be a 
single NIC t o said server's operating system 
and clients; 

means for treating said group as a trunk having 
multiple ports; 

means for selecting, from a source address of 
a packet received at said switch, one of said 
ports to reach said server; and 
means for selecting, from a destination address 
of a packet sent from said server, one of said 
ports to reach said client. 

11. The system of claim 10 wherein said means for 
treating said group as a trunk and said means for 
selecting a port to reach said server is one switch 
connected to said server via multiple NICs in said 
group. 

12. The system of claim 10 wherein said means for 
treating said group as a trunk and said means for 
selecting a port to reach said server is a plurality of 
NIC links to a plurality of switches. 



8. The method of claim 7, wherein said step of provid- 
ing fault tolerance comprises the steps of: 



30 



the switch seeing said MAC address used as 
said server's source on said multiple NIC ports; 
and 

the switch selecting one of said multiple ports 
by looking at said client's MAC address; 



35 



wherein data communication between said server 
and said client is maintained in the event of a dis- 
ruption in a link to said ports. 



40 



The method of claim 7, wherein said step of provid- 
ing fault tolerance comprises the steps of: 

connecting said server via multiple NIC links to 
a plurality of switches, in a hubbed tree struc- 
ture; and 

connecting said switches together with a 
switch-to-switch link to create a plurality of 
paths in said tree, such that a packet may be 
communicated over any of said paths; 
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wherein data communication between said server 
and said client is maintained in the event of a dis- 
ruption in one of said links to said ports. 
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10. A system, in a computer network, for trunking mul- 
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(57) In a method and system are provided for trunk- 
ing multiple links between a switch and a server, server 
drivers recognise and automatically configure additional 
installed network interface cards (NICs) or multi-port 
NICs as group members. A monolithic driver, or an over- 
laying driver shim makes the group of NICs appear to 
be a single NIC to the server operating system and cli- 
ents. Multiple NICs having the same MAC addresses 
and appearing on different ports are connected directly 
to a switch which treats the group as a single, logical 
port. Using a deterministic algorithm, the switch looks 
up a received packet's destination in the address table. 
A list of possible ports for reaching the server and a flag 
indicating that the server is to be reached via this 
trunked group of ports are retrieved. The switch selects 
a port based upon the packet's source address. On the 
trunk to the clients, the server driver performs the same 
deterministic algorithm on the destination addresses. 
The inventbn supports fault tolerance. In one embodi- 
ment, a single switch is connected to a server via mul- 
tiple NIC links. In another embodiment, the server is 
connected via multiple NIC links to a plurality of switch- 
es. To mitigate effects of the same source MAC address 
appearing on packets received from multiple ports in a 
group, the switch is notified that it is acceptable to see 
the server's MAC address appearing on several ports 
and is directed not to notify the system operator thereof. 
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